Threats to Validity: construct-irrelevant variances contributing to performance under-representation on Graduate Record Exam (GRE)
نویسنده
چکیده
The fundamental rationale for advancing the present investigation is traced back to the recognition that construct-irrelevant variances and construct under-representation threaten the value implications and the consequential validity of the tests, hence spoiling the appropriateness and usefulness of the test scores for the purpose of decision-making (Mesick, 1989). Accordingly, this article deals in the main with the potentially interfering variances giving rise to performance under-representation on Graduate Record Exam. To these tight objectives, after undertaking the pilot testing project, dividing the subjects into two groups and sketching out the instruments, the run t-test as well as the self-reported protocols ultimately revealed that some statistically significant differences existed in both anxiety and performance of the two groups, i.e., math less-interested-in test-takers and math more-interested-in ones as a function of anxiety and math-section-related face validity, i.e., test bias. Also, the verbal section of GRE aiming at measuring the intelligence of the test takers is argued. Pedagogically assumed, the concentration is placed on the premise that the extraneous and interfering parameters culminate in misinterpretation and misuse of the tests in which confidence is put so as to make some global or local decision. Hence, they must be to the feasible extent controlled and manipulated so as to enhance the validation of and eschew misconstruing and misapplying the intended operationalized trait and score meaning for judgmental undertakings and social enterprises.
منابع مشابه
Task-Based Listening Assessment and the Influence of Construct-Irrelevant Variance
Task-based listening tests such as IELTS require testees to listen to some information on a CD and simultaneously answer the related items. To answer such items, testees are expected to comprehend, analyze, compare and infer pieces of information while listening to the incoming audio material. The present research attempted to investigate whether the two major characteristics of question type a...
متن کاملOn the Substantive and Predictive Validity Facets of the University Entrance Exam for English Majors
This study examined the substantive and predictive validity facets of the University Entrance Examination for English Major (UEEEM) students. To that aim, 111 English major students were recruited to report their scores on each of the subtests of the test as well as their grade point average. Sequential multiple regressions and factor analysis were used in the analysis of the data. Results ackn...
متن کاملA comprehensive meta-analysis of the predictive validity of the graduate record examinations: implications for graduate student selection and performance.
This meta-analysis examined the validity of the Graduate Record Examinations (GRE) and undergraduate grade point average (UGPA) as predictors of graduate school performance. The study included samples from multiple disciplines, considered different criterion measures, and corrected for statistical artifacts. Data from 1,753 independent samples were included in the meta-analysis, yielding 6,589 ...
متن کاملValidity threats: overcoming interference with proposed interpretations of assessment data.
CONTEXT Factors that interfere with the ability to interpret assessment scores or ratings in the proposed manner threaten validity. To be interpreted in a meaningful manner, all assessments in medical education require sound, scientific evidence of validity. PURPOSE The purpose of this essay is to discuss 2 major threats to validity: construct under-representation (CU) and construct-irrelevan...
متن کاملThe Limitations of the GRE in Predicting Success in Biomedical Graduate School
Historically, admissions committees for biomedical Ph.D. programs have heavily weighed GRE scores when considering applications for admission. The predictive validity of GRE scores on graduate student success is unclear, and there have been no recent investigations specifically on the relationship between general GRE scores and graduate student success in biomedical research. Data from Vanderbi...
متن کامل